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Teaching Dossiers 

Thongaestion of evaluating effective teaching in^ 
light of the fact that teaching is still the principal function of • 
the university is addressed. Host* faculty receive very little 
specific training in teaching, even though the skills involved are 
coaplex and sophisticated. There is a dual responsibility for 
evaluation of teaching by faculty and administration, a type of 
collaboration that corresponds to the way most contemporary Canadian 
universities are governed. The main responsibility of .the 
administration should be to provide a climate within which effective 
teaching and learning can occur. A teaching resource center, 
sabbatical leaves, and research and development grants for faculty^ 
are examples. of encouragement or rewards provided to teachers for 
initiatives they may take. Faculty should not be constrained from 
practicing new approaches in their teaching. Teachers should provide 
information about their teaching performance that co^ld be used for 
evaluation- purposes. A te&ching dossier might contai^summaries of 
student course evaluations, comments by colleagues on the quality of 
the material presented in class, descriptions of innovative teaching 
'and learning tecbnigues, a^d evidence of some gain in knowledge or 
experience on the part of students. It is suggested that-teacters 
should claim credit for good teaching in the same way as they would 
take the responsibility to document scholarly endeavors and 
administrative work. The involvement or concerns of students and the 
community in the evaluation of teaching performance is also^ 
discussed. (SW) : . 
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Criteria of faculty performance 

A^fev years ago the Canadian Association of University Teachers undertook 

♦ 

a survey of salary policies in Canadian universities (see Knapper, 1974) • 
Results of the study showed that universities across the country vera fairly 
tmanimous In recognizing three or four basic qualities a faculty member must 
display ih order to be granted tenure, receive a merit increment, or be promoted 
The first three criteria were coixq)etence in teaching, scholarly or research 
capabilities, and involvement In the various administrative chores that are 
necessary today in most academic settings. A fourth area of contribution, 
-specified by about half ,the institutions surveyed, was that of work done 
^irectly for the community at large. Although teaching was placed first on the 
; list by the majority of universities responding, it is one of the worst-guarded 
secrets in administrative circles that the efforts being made to evaluate 
teaching are really quite crude, where they exist at all. i. 

The present paper is primarily concerned with the question of evaluating ^ 
effective teaching, but this by no means in?) lies that teaching is the only 
professoFfal-responstbility being assessed in an unsatisfactory way. Certainly 
it is easy to count up the number of papers a faculty member has published or to 

'■4 • > 

. iiake a list of the niimber of committees, on which he has served, but -this may 
be an extremely poor guide to that person's scholarship or contribution to the 

;^ smooth running of the academic community. In a recent Canadian ptjblication on 

the evaluation of instruction in higher education (Knapper, Gels,. Pascal, & 

Shore, 1976) the point is made by a number of writers that activities like 

research, administrative ability, public service, and so on - things which have 

* Paper presented to AUCC annual conference on "The Changing Conditions within 
. Universities", Regina, November 4, 1976. 



been generally assumed to be easily appraised -* should be subject to at least 

the same kind of scrutiny as that which is now being recommended for the 

teaching activity. Thus it might be asked not Just how imany papers a professor. 

has published or how much money he has obtained in the way of research grants, 

« 

but also what was the quality of the research y what was the' impact of its 
findings on colleagues or the community at large? Slmllarlly» instead of 
counting up committee memberships, consideration might be given to how well the 
committee functioned, what changes It effected, and so on. 

Notwithstanding these comments, it is probably true that the evaluation of 
teaching performance in universities is even more unreliable than assessments of 
research or administrative duties. One reason for this is that teaching has 
become such a lonely occupation. While only fellow committee ^members have to 
tolerate oui^ long rambling speeches, and while our papers may go unread except , 
by the Journal editored two referees, it is probably the case that not one 
colleague has ever watched xis perform in the classroom or in our variQusimore 
private teaching activities. In this respect even the^most general form of 
feedback about teaching performance is likely to be enlighteni.ng, and hence 
helpful. .But at the same time suc^x^lnfotTnatlon may alsp be startling and ^: 
threatening.' 

A second point to be made about university teaching is that faculty ''are 
usually very sensitive about their performance In this area. Much has: be^^ 
written to suggest that university professors are cavalier about their approach 
to teaching, but this generalization has^H^ be viewed j^lth a considerable degree 

of caution.' While it cannot be denied that some instruction - in universities 

V ^ ^ ' 
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leaves a lot to be desiredv-^there are probably/pj'ofessors who will openly admit 

.that they are bad teachers or that- they see teaching a^s unimportant. 



In contrast, the number of university faculty actively involved in research 
is much less than many university administrators would have us believe (for 
example y among academic psychologists in the United States the median- number of 
publications is apparently zero), and it is still quite acceptable ^|||shrug off 
a lack of scholarly activity by a cryptic reference to the "publish ^perish" 
phenomenon. As far as administrative contributions to the university are con- 
cerned, it is often easy to explain away, the failure to take on inch duties In 
terms of a desire to avoid bureaucracy and concentrate instead op the "real*' 
function pf the university. It is probable then that - at least, for many 
disciplines - a professor can live with the reputation of being uninterested 
in research or committee work, but will find it much more embarrassing to be 
stigmatized as a poor teacher. Teaching appears to be one of those activities, ^ 
like driving or sex,, where we are particiilarily sensitive to criticisml 

At the same time, promoting le^aming has always been the central role of 
the university, and with the rapid rise in 'student intake since the second 
world ^ar it is not sufficient to assume that learning will take place without 
difficulty as 'long -as stu^i^^ have access to a library and a few lectures by 

eminent scholars. Rather, to^ay a professor must become an expert in the facil- 
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itatidn of jleaming - which i4 another definition of teaching. 

The central role of teaching^ <i f >^ . 

There is probably little quarrel that teaching is still, the principal 
function of the university. It is also well known thdt most facility receive very 

little specific training in teaching, even tbough the skills involved are 

< ' I ' * 

.\ 

widely regarded/as complex and sophisticated. Of course, some academics would 
deny that- any sophistication in teaching skills is necessary, and would iijaintain 
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that university education simply involves exposing student^ to the appropriate 
subject-matter, and letting them learn for themselves (sere Anderson, 1974) • 
It has already b^en argued above that this is an untenable position In 
today's Canadian university environment. But saying that teaching is a 
'^*^'^dif f icult and complicated endeavour unfortunately does not mean that a lengthy 
immersion course 'in the principles of pedagogy will work the wonders that some 

educationists believe. In fact it could be maintained that the psychological 

( 

principles derived from studies over the last fifty) years have proved of 
remarkably llttl^ value for the everyday work of the classroom teacher. It is 
known that people must be motivated toi,.l^am, and that they learn better when 
pursuing some tangible reward. Psychologists are also beginning, through the 
work of Piaget, to xincover some fascinating Information about the way young 
children- think, which will' have gre*iL implications for the way they are taught*. 
Yet serious doubts remain about' whether exposure to the findings of learning 
theorists^ from Hull/ to Skinner, will help Professor X Improve his teaching, 
any more than will a conversation with a sympathetic colleague, or the comments 
of his students. ^ . . 

s 

^-J5ie fact that there are no pedagogical rtiles of thumb to ensure effective 
teaching makes it even more necessary that the university instructor constantly 
monitor his activities in the classroom. Thus the aim of evalxxation is 
flrsjnated foremost to provide a source of Information to the teacher about what 
he is doing and it also follows that evaluation should be as comprehensive as 
possible. For example, student questionnaires can provide Invaluable' Information 
about the practical organization of a class, about ^the perceived difficulty of ^ 
assignments, and the extent to which the course is stimulating and enjoyable. 
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But to obtain reliable Information about how relevant or up-to-date the material 



Is, It would be far better to consult colleagui^s or the department head. 

The situation described here Is one in which the teacher calls upon 
others for their advice: the initiative is left with him. It is probable 
that no other system will work in a xiniversity settinf^ where a good deal of 
flexibility and freedom has been traditional for many years. There is a 
dual responsibility here far * evaluation of > teaching by faculty and administration 
working together 9 a type of collaboration which is In keeping with the way most 
contemporary Canadian universities are governed. 

The ^ual responsibility of faculty and administration > , 

If the notion that teaching evaluation is a collaborative effort between 
faculty and administration Is accepted, then the next step is to decide what 
are the rights and responsibilities of the two parties Involved. The .main 
responsibility of the administration (ranging from department heads to the 
President) should be to provide a climate within which effective teaching and 
learning prosper » This means the clear articulation of alms for the 
university whf.ch place primary eisphasis on teaching, and living up to those alms 
In practice by, for example, funding a Teaching Resource Person or Centre, 
encouraging sabbatical and other leaves for the purpose of studying new teachliig 
methods » providing reseanrch and development grants for faculty who wish to try- 
new ways of presenting learning material* and so on. Notice that these are not, 
for the most part, formalized programs, but instead take the form of encouragement 
and rewards for Inititatives taken by Individual faculty members. Evidence from 
various parts of the world suggests that this sort of "grassroots'* approach Is 
far more successful In producing; changed attitudes and behaviour than many 
Inrpressive looking series of worlcshops and conferences on teaching, that may ^ 
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enhance th< prestige o£ the Vice-President's office, but do little to stimulate 
. cynical faculty and students. 

Another aspect of administrative respondlblllty that Is frequently Ignored 

/ 

concerns the general organization of Instruction in the institution. Faculty 
who wish to try new approaches to teaching often find they are hamstrung by 
adtninis trative regulations that are unduly restricting with regard to the 
tinilng and format of classes , the type of assignments that may be given, the ^ 
method of grading, and so on» For example » some deans and .department heads 
get quite nervous when they discover that an instructor is not physically in 
contact with his entire class for the four hours per week prescribed in the 
calendar* And deans who are faced with the very high grades often produced 
by students engaged In self-paced instruction (such as PSl) may be either 
* bewildered or hostile to this departure from the normal distribution of marks. 

So much for the responsibilities of the administration in this partnership. 
It will be seen that they have been mainly concerned with improving the climate 
for effective teachiiig, but that there Is no direct administrative responsi- 
blllty for evaluation itself. This is because, for some of the political, 

/' . 

social, and psychological reasons alluded to a^ove. It is extremeljr dubious 
that an evaluation system imposed from above ca^ succeed. Hopefully, however, 
if administrators provide appropriate rewards and encouragement, faculty will 
be motivated to develop and administer their own evalxiation systems, if only 
to demonstrate that their teaching is as good as they say* This may sQund 
naive, hut experience with many systems of incentives shows that they will not 
work unless the people Involved are convinced of their utility, clear about 
their philosophy, and have a meaningful say In their Inzplementatlon. 
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While this paper la coo short for a full description of the sources of 
information that might be used fpr evaluation purposes, it is worth empha- 
sizing again that few contemporary writers on teaching evaluation would be 
content with a single source - such as the ubiciuitoua student course rating 
questionnaire. A number of authors, auch as Shore (1974) and Sullivan (1976), 
have suggested that an instructor should prepare a dossier of evidence to 
support his c^aim to he an effective teacher, ii^/much the same way as a 
-curnicultmi vitae is assembled to describe recent publications, research grants 
held, consaittee responsibilities, and so on. Such a dossier might contain 
summaries of student course evaluations, comments by colleagues on the quality 
of the material presented in class, descriptions of Innovations which have 
taken place in the course, and (best of all) evidence of some gain in knowledge 
or experience on the part of students. 

The latter index of student achievement, which is really a much more 
important comment on the value of a course than are the opinions of either 
students or colleagues, is often difficult to obtain with any precision. (Of 
course an examination should measure learning, providing there is some indication 
that students could not already perform at the same level at the beginning of 
the class.) A good deal has been written about measuring student achievement in 
relation to specified course objectives (see the bibliography by Geis, 1972) 
and one unusual way of doing this is to get follow-up comments from employers, 
who are in a particularily good position to assess the relevance ' student 
knowledge and skill. Unfortunately however, this sort of feedback only 
possible in some academic disciplines (such as psychology or engineering) and 
isi any case is hard to measure- accurately. Because the measurement of course 
Outcomes (In terms of student achievement or changed attitudes)"" is not at present 



being done very thoroughly or precisely, the evidence a faculty member presents 
to claim credit for teaching effectiveness may be ^rather vague* Furthermore, . 
it is likely that such information, albeit incomplete, is ^Ciovhere nearly as 
vague and inaccurate as the more usual comment on teach^^ in the faculty 
promotion form, where the department head pens an eloquently equivocal para- 
graph to describe the performance anxl ef ftictiveness of a teacher he has never 
seen perform in the classroom, and with whom' he has discussed teaching only in 
terms of generalities. 

It has been suggested above that the onus should be on a faculty number to 
claim credit for good teaching in Just the same way as it is his responsibility 
to claim credit for scholarly endeavours and administrative work* Some faculty 
will choose not^ to defend their teaching, in which case administrators must 
^ assume that It is only average, at best - Just as a faculty member who did not 
bother to submit his list of publications for the year would be assumed to have 
published .nothing. In the regular review process that most universities use 
to appraise faculty performance, some professors will claim credit for exceljentj 
teaching, while others will be energetic researchers or provide invaluable 
administrative or counselling services for the department. A few will excell 
at many activities, but one of the greatest mistakes made in administering an 
academic unit Is to assume that all members will contribute In the same way by 
the same means. Once teaching, research, administration and so on are all 
evaluated' to an equal degree, there will emerge a much clearer picture of 
'where faculty talents lie. 

This implies, once again, that the university administration should provide 
Sufficient flexibility for the resources in a department to be utilized to their 
maximxim potential. The first step here Is ,to recognize that not all faculty 
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•re good «^,««earch, cany jtre terrible «dalnlaCrator« . and a frw arc poor 
teachers. There should be «ufficient freedom to let faculty concentrate on 
thoae aspects of the department's work that they do beat. As far as teaching 
la concerned, it is also vital to realize that there are ^eVy many ways to 
teach in a university besides giving lectures or running seminars, and that 
many informal contacts with students are an loportant component of the 
university learning process. 

The Involvement of sjrudents and the cogcnuolty 

Tffe bulk, of this paper has been devoted to a discussion of evaluation 
in terms of the responsibilities of tvo groups - administration and faculty. 
But there are two further groups whose interests are vitally bound up with 
the qxiestion of teaching effectiveness. The first of these of course is the 
student body, since students are the people to whom the whole teaching enter- 
prise is directed. (Notice that the reference here is to the teaching 
enterprise, rather than "learning", which is an activity shared by students 
and faculty alike.) In the remarks above it has been emphasized that the ultimate 
test of teaching performance is demonstrated learning - whether of skills, 
Jmowledge, or attitudes. It has also been mentioned that student evaluations 
(by questionnaires, for example) can provide invaluable info^tion about certain 
aspects of the teaching process. However, because the effective evaluation of 
teachini involves more than a detenalnatlon of which professors are perceived to 
be best by their students, and because evaluation must be an ongoing system 
for ptoviding faculty with Infonnation. that will help them improve over time, 
it is argued that the main impetus for the evaluation of faculty performance 
must lie with the administrator-faculty partnership discussed above. This is 

t 
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not Co deny that ncudcnt input co Che i»v;)luatlon proceii» Im unique and Invalu- 
able. Furthenore Ic aaeumee that eCudente will probably continue to carry 
out chclr own eurveyii of traching» and thme auiy have cona ldc;r4ble impact, 
especially In the absence of otVier an^' ' "^ncer data. 

The final group with a vested it-^^ c^t in this ouitter of evaluation 
larger than faculty^ students and administration cot&bined. It comprises the 
cooDunity at large. In whose naise every segiaent of the vmiversity claims to 
speak from time to time» but whose real desires are probably unknown. The 
contemporary university is a auch misunderstood ins ti tuLiv*u : snd nowhere is 
public tola understanding more prevalent than with regard rc zh^ ^ caching process 
In particular^ there is often a confusion in the public's nlnd between formal^ 
contact hours in the classroom and the total amount ^ of work done by a 
professor (for an interesting discussion of this at*'! rude, and the reality of 
the situation* see Trotter* McQueen, & Hansen. 1973). An the costs of higher 
educatloa have locreaaad in the past decade , so havs che demmd s by govanuasnt 
for public accountability for funds spent. Any valid type of cost-benef it 
analysis of the universities' achievements la extremely hard to carry out* 
because of the tremendous difficulty of pinning dovn the variables involved. 
In the mid 1960s the Labour Covertiment in Britain tried to apply its prices 
and incomes policy to university teachers » and suggested that possible indices 
of "productivity" might include faculty-to-student ratios and student course 
evaluations. The attempt was eventually abandoned in the face of arguments 
vithln the cabinet that to specify the effectiveness of higher education in 
such relatively crude terms would do more harm than good to the educational 
enterprise* 

Certainly the university is accountable to the public , but it can probably 
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only be accouatAble In a v«ry general way, bccAuae of Che cofsploxlty of the 
mmny Activities undertaken by etudentd and faculty lo higher education. It 
In doubtful whether unlveml t lea will ever achieve unlvemal popularity 
among the public at large, reRardlena of how well they perfona. But they 
ciuet at Iraat be capable of ReneratlnR a degree of tolerance for the work 
they are doing, and a public acceptab 1 1 1 e y that the bllliona of d^llara apciit 
on higher education reault In aooc beneficial changea in the quality of life 
tor the population aa a whole. To achieve thla, univrrrtltlea nuat not lo»c 
eight of th<?lr taaln function, which is to pasa on to succeeding generation-, 
of students the accusulated wlsdois of tnanklnd, and to transmit thla knowledge 
in tha aoat effective way possible. A better understanding of the teaching 
and learning process is essential to achieve thia aia, and ensure Che survival 
of the university as a vital force of influence in the conteiaporary world. 
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